Serena Williams
“Tennis is mostly mental. You win or lose the match before you even go out there.”
| Feature | Microsoft | Skybiometry | Animetrics | |
|---|---|---|---|---|
| Face features | ✔ | ✔ | ✔ | ✔ |
| Head angle | ✔ | ✔ | ✔ | ✔ |
| Basic emotion | ✔ | ✔ | ||
| Face landmarks | ✔ | ✔ | ✔ | |
| Scene labels | ✔ | |||
| 3D points | ✔ |
API: Application programming interface
APIs are built to be part of a larger program.
(for example, a camera app)
In order to use them, we need to write scripts to use the API.
Detecting faces in each image typically took 3-4 seconds.
To complete all 6406 images, it would take 5-7 hours, per API.
Some APIs had usage limits, and took several days to run.
We have all our data!
(toward the end of the original project window)
Check if the software is producing sensible output.
Collected data was spread across 6 files, to analyse it, we need to merge it all together.
We also need to determine if the boxes from each API match the same face.
This is also important for importing the extra face information from the manual classification.
Comparing every box generated, if the intersection of the box was >10%, they matched.
Player close-up
Birds-eye view
As expected, they reduce the detection.
Facial recognition software needs work to improve detection of faces, let alone emotion.
Some basic emotion is possible, however the precision is questionable, especially with players expressions during a game.